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ABSTRACT 

Distance education can be examined in three ways. It 
can be analyzed from the standpoint of its teaching, administrative, 
and assessment systems. The three systems are interrelated, and 
examining each of them — first in isolation and then in conjunction 
with the other tr^o — can provide a coherence that is useful in 
teaching and iniproving distance education programs. Evaluations of 
distance education teaching systems should begin with an examination 
of the general theoretical statements that have been made about 
distance education. Focus should be on the role of various media in 
teaching at a distance, the significance of two-way communication, 
and the effect that pres>cntational devices within texts and a 
coherent structure of the subject content have on the effectiveness 
of a distance education program. Although such theoretical statements 
are too general to be of great practical value, they suggest a way in 
which narrower (and more useful) dependent theories can be developed 
from them. When the administrative system of a distance education 
prograip is evaluated, generalizations can be drawn from practice that 
may offer useful hi^uristics and may thus, in time, serve as the basis 
for administrative theories. Distance teaching institutions may be 
classified in terms of their governing structure and functions. The 
system for assessing a distance education system must include value 
judgments about educational quality and indicators of that quality. A 
46-item reference list concludes the document. (MN) 
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Summary 



Theory is seen as being of value to distance education where it can help solve 
problems. While there are advantages in taking a narrow definition of theory, 
generalisations from experience may also be of value both in solving problems 
end as a first step towards the development of theory. Distance education is 
examined in terms of three related systems, concerned with teaching, with 
administration and with asses^sment. Theoretical statements are made U 
discussing teaching and concern the use of media, the role of feedback aind 
face-to-tace tuition, and the development of teaching materials. In the 
administrative system generalisations, which can guide practice, are made about 
the classification of audiences for distance education, about the governing 
structure of distance- teaching institutions and about their functions. The 
assessment system demands the use of a battery of measures to examine distance 
education from the standpoint of its performance, as measured by its effects on 
its students, its adequacy in relation to the total amount of need, its 
efficiency, and its process, requiring an examination of the quality of the 
educational process itself. While all four standpoints are important, 
theoretical statements are made only about efficiency and the assessment of 
process has been relatively neglected in the literature. The assessment system 
requires the use of value judgments with values, on which universal agreement 
cannot be expected, that are derived from social and polit<cal philosophy. 



Zusanicnenf&ssung 



FQr das Fernstudlum wlrd Theorie dann als hllfreich angesehen, 
wenn es ihr gelingt^ bei der Problemlosung behilfltch su sein. WShrend 
eine enge Definition von Theorie von Vorteil ifit^ liegt der Wert von 
Generaiitierungen aus der Erfahrung heraut iowohl in der Problem- 
ISfiUng als auch Im erBten Schritt lu einer Theorieentwicklung hin. 
Fernstudlum wird im folgenden unter drei mitelnander vf rknSpften 
Syateniaspekten betraclitet: den Sygtemen der Lehre^ der Verwaltung 
und der Erfolgi lontoUe. Fflr die Theorie dei Lehrens reievante Aus- 
sagen verden lu folgenden 3erelchen gemacht: 

- Verwendung von Medlen 

- die Rolle von Feedback und Dlrektunterricht Im Ferostudium 

- die Entwicklung von Lfehrmaterial 

FQr den Aspekt der Verwaltung werden praxlsanleltende GeneralUie* 

rungen gemacht fiber: 

>Struktuk* von Fernstudien-lnstltutlonen 

-haupts&chllcbe Funktionen 

DaB System ErfolgskontroUe erfordert die Verwendung elner ganzen 
Re\he von Massnahmen, um das Fernstudlum vom Standpunkt der 
QualitSt seiner Durchfuhrung zu Qberprufen : 
• gemessen an s^inen Auswirkungen auf die Studenten 

- die Befriedigung etner bestehenden Gesamt-Nachfrage 

- seiner Effisienz 

- seiner DurchfOhrung; 

all diesc Kriterien bedurfen auch der Betrarhtung des Bildungspro- 
zesses als solcfaem. Wahrend diese vier Kriterien wichtig gind. mu8 
glekhwohi fcstgcstellt werden . dass hier theoretische Anssag^^n im 
eigentllchen Sinne in der Llteratur xum Fernstudlum xlemlich selten 
vorkonimeii und dann auch nur die Efflatienz und die Cberprflfung des 
LernerfolfiCH beireffen. Has System ErfolgskontroUe erfordert nfimllrh 
den Verweis Huf Werturteile. uber die ein Einvernehmen allgemein 
wohl nlrhf erzielt werden kann: Vorannahmen aus der suEiaien and 
polltlschen Phlloeophle. 
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Td like to start by putting my philosophical cards on the table, setting out the 
assumptions that Me behind this papar. I do this not only as a necessary 
foundation for It but also because these are not what I want to talk about 
today. 

To begin with, my Interest Is In solving problems and I see the role of theory 
as one of helping to solve problems. The fundamental problem lying behind the 
I paper is this: 'how can we best enable people to learn at a distance?'. 

Next, I see merit In taking a narrow view of theory in the sense of, 'a set of 
hypotheses related by logical or mathematical arguments to explain and predict 
a wide variety of connected phenomena in general terms' (Urdang 1979), seeking 
theories that can be falslfleJ, and that allow predictions'. While the 
acceptance of this narrow, Pcpperlan, meaning of the term places limits on what 
we can class as theory, it makes any theoretical statements we do accept that 
much more powerful. At the same time we need to avoid what Lakatos calls 
•naive falsification' and instead seek 'sophisticated methodological 
ftlsif icatlonlsm'; the hope is not to find a single refuting example to set 
against any theoretical proposition but from any such examples to build a 'new 
theory [which! has some excess empirical content over its predecessor, that Is, 
...it predicts some novel, hitherto unexpected fact' (Lakatos 1978, p.33). 

As we cannot - or I cannot - develop theoretical statements about all the 
interesting problems in distance education I also see merit in seeking 
generalisations that fall short of theory. I borrow this distinction fro-n 
Runciman's (i983) discussion of the relations between theory, generalisation and 
practice in the social sciences which rests on an analysis of the neturt^ of 
understanding. Ha distinguishes between three meanings for the term 
'understanding'. In its first sense, understanding arsw^rs the question 'what l5 
happening?' and, in his terminology, concerns reportage. In the second sense 
understanding demands an answer to the question 'why?' and is concerned with 
explanation. In the third sense it involves answering the question 'what is it 
really like?' and so requires description. Thus, if we examine a picture of 
Latin American students of a radio school, learning with their their texts and 
^ theJr radio, wa can ask 'what is happening?' and expect reportage, such as an 
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observing newspaper reporter might give. If we go on to ask 'why' we may get a 
range of answers, some concerned with the sociology of Latin America and some, 
our major concern here, explaining why people can learn at a distance. We may, 
however, want a different sort of account and seek the detailed description that 
alone can tell us 'what is it really like' to be the campes ino student we see in 
the picture. 

Runciman goes on to claim that in its first sense, in the realm of reportage, we 
can produce generalisations but not theories; when we ask 'what is happening' we 
are not asking a question that leads directly to theory. It is only in the 
second sense of the term 'understanding', where we are seeking explanation- that 
we can develop falsifiable and predictive theoretical statements, I will, 
however, argue that we can legitimately derive heuristics, or rules of thumb as 
a guide to practice, from genera Msat ions as well as from theoretical statements 
and also that the development of generalisations out of reportage can be the 
first step towards the development of theory. 

One finijl philosophical view and we can get back to distance education. I see 
education as being multi-faceted and find Stenhouse's categorisation 
particularly useful. He distinguished between four types of educational 
activity: training, where we are concerned with skills; instruction, where we 
are concerned with information; initiation, where people are being initiated into 
social norms; and induction, where people are being introduced to thought 
systems enabling * 'dgment (Stenhouse 197«s n 80ff). If we are to solve 
problems in distance education - in helping people learn - then we may need to 
concern ourselves with all four types. 

Enough of philosophy and presuppositions, '^'he problem that sparked oft the 
paper was more modest than my broad concern with the problems of learning at a 
distance. It derives from work I did ne International Extension College 
with the University of London Institute of Education when we were seeking a 
structure for teaching an MA course on distance education that would be 
coherent and would help towards identifying generative concepts (cf Bruner 19^2, 
p, 121). The structure proposed here served that purpose and may also be of 
value in helping with the practice of distance education. 
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To provide a structure for analysing some of the Interesting problems of 
distance education and so seeking answers to the starting question, we can 
examine distance education in three ways, analysing learning at a distance, 
analysl..g the administrative structure which It needs, and analysing the methods 
of assessment which He behind, and permit, answers to the question. We can 
regard this process as one of examining three systems which are related as In 
figure 1. In examining the teaching system v/e know that there Is a black box 
labelled 'administration' which we do not examine at this stage, and a further 
black box labelled 'assessment' which contains within It certain presuppositions 
and techniques which we use in analysing learning without examining them. 
Similarly, in examining the process of administration In distance education we 
tree* as black boxes both the assessment system and the teaching system which 
w. previously the focus of our attention. And, In looking at assessment, we 
do not examine in detail the learning and administrative Issues examined in the 
other two systems. 



The t€.achlng system 

In discussing teaching, we can start with a broad question such as 'how do 
people learn at a distance?'. Theories are of value If they can answer such 
questions as, 'what sort of media should we use? how much face- to- face learning 
Is necessary? how do we design materials?'. This paper does not develop a fully 
fledged set of answers to such questions; rather the aim Is to suggest the kind 
of answers that we can expect to them and so the kind of theory that It Is 
useful to seek. 

Research on learning, much of It laboratory based, has often produced statements 
which suggest that process (y) leads to more effective learning than process 
(y). The five theoretical statements about distance teaching, discussed below, 
are of this kind; their practical value. If they are sound. Is that. In this 
domain, we can make properly theoretical and falslflable statements. Five such 
statements Illustrate the kind of theory which we can expect and use as a guide 
In planning for effective learning. 

The first statement was made In a specific form by Trenaman who compared the 
Q presientatlon of Information through radio programmes, television programmes and 
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print, examining differences between the media end between the backgrounds of 
the adult learners who were his? subjects. He classified them in terns of their 
education and types of occupation^ gr ped together in 'occupatlcn grades'. He 
found that, 

The outstanding feature of the analysis is that differences between one 
programme and another, and differences between the occupation grades are 
very significant indeed, and account for more variation than any differences 
between one medium and another. 

(Trenaman 1967, p. 40) 

This finding reflects earlier work which compared radio and face- to-face 
education (cf Cantril and AUport 1935 pp 171-2 and Woelfel and Tyler 1945, pp 
26-7), and foreshadowed studies of television which produced similar findings of 
no significant difference (Chu and Schramm 1968). We can state the theory of 
media equivalence baldly co mmunications, media do not differ in their 
educ at ional ef fect ivenes s. 

In making the stacement, jt is assumed that the term 'educational effectiveness' 
leaves out of account questions of motivation which we consider below. Thus 
one might expect the theory to be developed further by reference to differences 
between individuals in their preferred method of learning and in their 
Interaction with different communications media, or perhaps by reference to 
different types of learning. 

The practical importance of the theory is, as Chu and Schramm forecast, in 
liberating the educator to choose a medium according to the convenience and 
needs of the learners, and in response to the costs of the alternatives. 

The next theoretical statement might seem to be in conflict with the first. It 
claims that distance- teaching programmer whlrh use a combination of media are 
likely to have a higher succe ssful completion rate than those which use a 
stngle i^edtupi. The contradiction is more apparent than real as different 
combinations of media may have differing effects and different media can affect 
motivation, as opposed to learning, differently. Moreover, 'short of an absolute 
science of learning and instruction ... some Justification exists for a "shot gun" 
approach. To the extent that our choices of media are faulty, use of several 
media in redundancy may be to some extent Justified' (Briggs et al. 1967, p. 14). 
The practical advantages of combining broadcasting with print and with face-to- 
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face learning was a starting point both for the National Extension College and 
for the Open University. The reasons for It He In the power of broadcasts to 
stimulate, the power of face-to-face tutoring to relate subject matter to 
Individual response, and the power of print to give permanence. And yet, we 
remain short of hard emplrlc(il evidence to add weight to the theoretical 
statement and further data to refine the theoretical statement would be 
valuable 

Theories of distance education need to consider broader Issues than the choice 
of medium; among these are the roles of two-way communication. Such two-way 
communication has at least five functions: to encourage, to correct errors, to 
signal difficulties on the part of the learner, to Inform those who prepare 
educational materials, and to allow learner and teacher to take off In 
directions which had not been forecast. This last capacity Is, for many 
educators of unique value and Importance, lying at the heart of the educational 
process If It Is to be worthy of the name-^; the term 'value' reminds us tliat we 
will come back to these Issues In the assessment system. In face-to-face 
learning all types of two-way communication may be achieved at about the same 
time, and using the same channel. In distance 'Education, In contrast, we may 
need to organise different channels of communication for these different 
purposes . 

Feedback In distance education, carried by one channel or another, generally 
takes one of two forms; it Is either impersonal and immediate or personal and 
delayed. You may find the answer at the back of the book, or in thirty seconds 
time from the radio tutor, or you may get an individual response from your 
tutor after a delay of some days or weeks^. The evidence for the success of 
distance education, such as it is, confirms that a combination of the two types 
of feedback can lead to effective learning, although the last of the functions 
Identified is more difficult to achieve than in face-to-face education. The 
success is qualified, too, in that delays in feedback can inhibit learning (cf 
Rekkedal 1983, p.217). We could thus sum up that a combination of Immadiate 
and delayed feedback can lead to effective learning ^ ut there is a significant 
ne gative correlation between measures of effective learning and the length jf 
the delay . From this statement we would like to derive more precise and 
limited ones, about the circumstances under which delay and Impersonality are 
-"Ore or less important. It seems reasonable to assume that there will be a 

^ , 10 
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contrast between different subjects, or different kinds of educational activity, 
and more precise statements are needed to help, for example, with the design of 
effective teaching In mathematics as compared with languages 

The next theoretical statement claims simply that face- to-f ace tutoring, or an 
alternative form of simultane ous two-wav communication, increases the 
effoctlveness of distance education. Again, rhe statement could usefully be 
refined, perhaps towards suggesting chat the need for face-io-face tuition 
varies inversely with ths motivation and sophistication of the learners, but 
this will advance us significantly only if we can put some quantities to the 
terms •motivation' and •sophistication'. As it stands, the statement seems to be 
in accordance with the evidence and can serve as a starting point for more 
detailed and practical discussion about tutorial work. When coupled with 
statements, about the cost behaviour of distance education it takes us to the 
heart of the distance educator's dilemma: how to reconcile the educator's 
demand for more and more face-to-face contact with the populariser's d2slre for 
ever larger audiences and the budget controller's desire for ever lower unit 
costs. 



So far we have been concerned with broad issues about the role of various media 
in teaching at a distance and the significance of two-way communication. There 
remain, however, problems of instructiom design: how do we ensure that printed 
materials, or broadcasts, art effective. Here there is a considerable literature 
whose significance is, in part, that it has generated theoretical statements of 
these kinds: 

'personification, dramatisation and a story form, then, assist understanding 
at the lower levels' (Trenaman 1967, p. 109); 

or, on teaching by radio, 

•reinforcement by being Informed of the results Increases the rate of 
learning. (In most cases the radio teacher asks the children to give oral 
or written responses, and Immediately thereafter gives them the correct 
answer)' (Galda and Searle 1980, p.4). 

Holmberg (1985) has put a number of statements of this kind, on both course 
d-^sign and tutorial support, into a theoretical context. But far more of the 
literature is in the form of practical guidance on writing or making broadcast 
programmes rather thau of theoretical statements. Many institutions have 
pro-Juced their own internal guides to course development and there is now a 
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considerable number of more general guides (e.g. Holmberg 1960, Perraton 1973, 
Romlszowskl 1981, BfiAth 1983). In somt cases the advice given Is severely 
practical and, while based on empirical evidence and on hunches of what works 
effectively. Is not placed In any theoretical context. Iii other cases writers 
have tried to relate the particular of writing correspondence courses to thp 
genaral views of educational theorists such as Ausul^el or Gagn6, From the 
literature one can derive a variety of properly theoretical statements which 
respond to the problem of students' need to learn in isolation from tutor or 
peers. The statements are in such forms as these: 

'the presence of advance indicators in the text increases learning'; 

'the use of the first and second person and the active voice makes a text 
more accessible to students than the use of the third person and the 
passive'; 

'orgenisation of the subject matter ip. a coherent structure which takes 
account of the learner's previous knowledge increases learning'. 

International Extension College (1979) and BfiAth (1983) are useful practical 
guides which give rise o statements of this kind. 

This is not the place to summarise the literature. It is, however, important for 
the general argument to show that theoretical statements of the kind wtlch 
appear in it can be subsumed xti a general statement that learning at a distance 
can be made more effective by the use of presentational devices within the text 
and by a coherent struct u re of the subject content . As with the previous 
theoretical statements this does not, in itself, take us very far. Ratl.er U 
stands as an overarching theory on which others, that are more immediate guides 
to practice, can depend. 

The point, then, of developing these five theoretical statements about learning 
is to suggest a way forward, in which more detailed theoretical stakprn^nfc; nf 
the same kind are generated, that respond to the problems of jur learners. The 
ease of generating such statements is, as will be shown, a conti'ast with the 
administrative system where it is far more difficult to go bevond 
Q generalisation. 

ERIC ] 2 
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'^he>^e are, however, four difficulties In uslrjg thn theoretical statement? as 
they stariu as a guide to 'Solving tho problems of designing effective distance 
education. The first has been touched on elready: they are too broad and 
general and it is their narrower descendent theories that are more important. 
Second, we cannot consider them in Isolation from the adm<':lstratlv€ issues, and 
need to ask what Is administratively fe^isible a? .'ell as what is desirable for 
effective learning. Third, ;hey depend albc on issues of assessment, if only to 
reach agreement on what we mean by increased leaming or effectiveness. 
Fourth, the discussion so far ha5> been too simplistic, and has seemed to assume 
that there is a single, simple, entity called 'learnin<5V In practice, differences 
between types of learning mean tnat an adequate theory needs to specify what 
type of learning is '^eing considered if the theory is to be eny actual use as a 
guide to practice A challenge for practice and for theory is to consider ways 
in which distance education can be effective not only in training and 
Information but also In Initiation and Induction. 



The ad min 1 st rat I ve system 

I want to touch on administration very briefly end do so with two alms: to show 
how It relates to the other two systems and to suggest that It is a domain In 
which we are limited to generalisation and have not developed theories'*. 

An opening question for the analysis of administration in distance teaching and 
for solving prar icol p -)blems Is, 'what administrative structure Is necessary to 
ensure learning at a distance?'. To begin answering It the administrator will 
need to consider the nature of the Instltutlons's audience, escamlnlng It ^n 
terms of variables such as social and educational background, location, age, sex 
and occupation. It is then useful to classify administrations In terms of their 
structures and their functions. Classifications of this kind are limited 
value slmp)y because they are no more than generalisations from reportage of 
administrative practice. But they m^y help us In making for better Informed 
decisions about creating or developing distance- teaching Institutions^, 
Identifying areas of possible conflict. 

We ca-. classify distance- teaching Institutions hi terms of their gow^rning 
^ structure, dii>tln9ulshlng four main types of model: ^ 

ERIC 
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1 autonomous Institutions concerned Just with distance teaching (e.g. the 
British Open University); 

2 semi-autonomous institutions (e.g. the Lesotho Distance Teaching Centre 
which is responsible to the ministry of education tuv was established with 
some autonomy); 

3 departments of larger organisations where there 's a department 
responsible ior distance teaching alongside other departments. We can 
subdivide this group in four ways: 

3.1 departments concerned with a single subject only (e.g. College of 
Estate Management of the University of Reading); 

3.2 wider ranging departments which have their own administrative and 
teaching staff (e.g. University of Wisconsin Extension); 

3.3 departments which have both administrative and educational staff 
concerned with distance teaching but rely on their parent institutions 
for subject specialists rather than employing their own (e.g. Department 
of external studies at Murdoch University); 

3.4 departments which have administrative staff only and where 
pedagogical as well as subject specialist expertise rests with the 
parent body (e.g. University of New England and University of Zambia). 

4 co-operative structures where different parts of the process of distance 
teaching ar3 carried out by separate but co-operating Inscitutions (e.g. 
FlexiStudy in Britain)^. 

The models are set out in order of declining .^i>conomy. As we move from class 
1 to class 4, so thfe institution has less independent control over its 
educational work. While a fuller examination of the concept of autonomy might 
take us towards an administrative theory this laore modest set of categories 
makes it possible for the educational planner to generalise ana to compare the 
merits of alternative governing structures for a particular educational purpose. 
It thus provides a framework for decisions about, for example, the advantages of 
model 3.2 as against 3.4. To caricature the a.^gujienl, you can seek to recruit 
teachers truly dedicated to th3 needs of ext»^rnal students in model 3.2 but in 
model 3.4 you cf%n onsure thit external students are taught by as distinguished 
academics as Internal student£ and not Just by extramural tutors. We can also 
^"'le that conflic*:r between editcrs or course designer^*, for example, and 
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subject-m. Uer specialists will take a olfferent form within different 
administrative models, and require different structures to resolve them, 

The concept of autonomy is useful, too, in examining the internal functions of a 
distance- teaching institution, our second way of categorising within the 
administrative system, Here, it can illuminate questions about the control of 
an Institution's various functions. 

We can distinguish seven functions, although some institutions will have fewer 
than this number where others are assumed by their parent organisations or by 
other bodies. Most will have the first five: 

the development and production of teaching material, or the ability to 
acquire it from elsewhere; 

storage and distribution; 

tutoring, counselling and arranging feedback from students; 
a record system (of students, tutors, materials, processes); 
a financial system. 
Many institutions will also have: 

a recruitment structure to attract and Inform potential students; 
a capacUy for research and evaluation. 

The way these functions are exercised, and the internal administrative structure 
required to control them, are determined or at least influenced by the governing 
structure of a distance- teaching Institution and by the nature of its audiences, 
A fully autonomous institution like a Latin American radio school, for example, 
requires an administrative structure with all seven functions. An institution 
with a similar administrative model but without its own radio station will need 
rather less developed forms for some of the functions: it will not need its 
own radio transmitter. But its reliance on another organisation's transmitter 
will create the need for a structure for co-operation with those running the 
radio station. As a generalisation we can argue that the more autonomous an 
institution, the greater are the administrative burdens which fall on its own 
staff while, the less autonomous it is, the more it requires administrative 
structures for co-ooeration with other agencies. By using classifications of 
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this kind the planner can examine alternative ways of meeting a distance- 
teaching Institution's administrative needs. It is possible then go on to 
examine the location ox different functions or activities and identify where 
conflicts of Interest will arise as a consequence of such location. 

Such generalisations, even though they are short of theory, can be of value, 
then, in identifying administrative Issues which the project planner or distance- 
teaching administrator needs to address. But, in using them we are constantly 
driven back to the teaching system, asking, 'will this administrative change help 
or hinder people's learning?' and on to the assessment system, asking, 'are the 
social and educational consequences of this decision desirable or undesirable?'. 



The assessment syste m 

The development of poMcy for learning or administration is not neutral: in 
analysing policies we have repeatedly been forced into making value Judgments. 
To complete the picture of distance education we need therefore to ask about 
its quality and ebout the criteria by which we will assess that quality. In 
doing so we undertake two distinct activities, determining the values by which 
we will Judge an educational programme and using these values in making an 
assessment. Although the first of these activities lies within the domain of 
" social or political philosophy, the second does lend Itself to theoretical 
statements; once we have agreed on the value Judgments to be used then it 
should be possible to say, on the basis of comparative research, that programme 
<a) is likely to achieve more favourable results than programme (b). 

All of this is <^qually true for the evaluation of conventional education. 

In this domain we can begin by asking, 'is a particular distance- teaching 
programme any good?' and seeking indicators of educational quality which, if at 
all possible, parmit quantification. (Even if we eschew quantification we may 
want to ask as difficult questions about the presence or absence of a quality 
we value.) The search for quantification is a painful one for educators 
concernad about qualities that are not easily measured. While there are no easy 
solutions, some of the disadvantages of a narrow quantification can be avoided 
^ by using a battery of different measures. 
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This paper does not take a stance on methodology or review the extensive 
literature on educational evaluation. In the light of the literature It Is, 
however, possible to propose a framework for evaluating distance education with 
an appropriate battery of measures. Following Wvork done by McAnany (1975, 
pp240-l) In evaluating radio schools four criteria are proposed: performance : 
the effect that the programme has produced among Its target population; 
adequacy : the degree to which effective performance Is adequate to the total 
amount of need; efficiency ; the ratio of Input to output or effort to effect; 
process ; an assessment of the quality of the education as an activity In 



Itself®. 




Much of the assessment and evaluation of distance- teaching programmes and 
Institutions that has been carried out can be examined within this framework. 



Two measures of internal efficiency have been widely used to examine 
performance . The first is a measure of learning, often using examination pass 
rates as an indicator. A measure of this kind is, of course, more easily applied 
in formal programmes leading to paper qualifications than in nonformal education 
and has been widely used for such programmes. Sheath (1965), and Jevons 
(1982), for example, have used this kind of measure in examining the performance 
of distance and conventional students at Australian universities. Tests of 
knowledge gain have, however, also been used in assessing more nonformal 
programmes, such as the Tanzanian health campaigns (cf Hall 1978) or Ghanaian 
farm forums (cf Coleman and Opoku 1968). The second measure is of the 
successful completion rate; if we are satisfied that completing a cour^a will 
produce the intended effect in a target population, then this is an accept'^ble 
Indicator of oerformance^. 

It is much more difficult to determine appropriate external measures that will 
indicate the adequacy of our work. There Is some experience in evaluating 
nonformal courses by reference to the effects they had on people's everydaiy 
life, through changes in their health or agricultural practice, as opposed to 
tests of their knowledge of health or agriculture. The Basic Village Education 
Programme in Guatemala did this in relation to agriculture; there have been 
attempts to do it in relation to health campaigns in, for example, Latin America, 
California, the Philippines, and Tanzania^^"*. But these, and a handful of others, 
^ are »^are exceptions to a general rule that the cost and technical difficulty of 
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attributing social effect to educational cause prevent direct measures of 
adequacy. 

It is not much easiei to develop measures of adequacy in relation to formal 
courses. The difficulty is not, of course, peculiar to distance education. Many 
evaluations in practice use proxy indicators which are an appropriate measure of 
adequacy only if we are already satisfied t^ c the educational programme is a 
useful response to a public educational need. Once this assumption is made, one 
simple method of assessment is to ask about the audience reached by a distance- 
teaching programme, in terms of its wealth, or educational background, or 
location - all issues which were touched on In considering administration. 
There is a rich lode of research that has been mined by the Open University 
here (cf, for example, Mcintosh, Woodley and Morrison 1980). Comparison with 
other programmes is made possible by such research, but it Is still seldom easy 
to determine the sl-^e of the potential need against which a programme should be 
assessed. 



Another possible measure is the rate of return, or an attempt to measure ir 
financial terms the benefits which arise from having gained a qualflcation 
through distance learning. Following analysis of rates of return for education 
more generally (cf Psachoropoulos 1973 and 1980), Mace (1978), for example, has 
used this principle in an attempt to compare the value of the British Open 
University with conventional universities^^. A further possible external 
measure of the status of a distance- teaching institution is the extent to which 
its qualifications, or its graduates, are accepted by other and more conventional 
institutions. This would seem most appropriate if a programme had as one of 
its major alms the production of future scholars. 

Despite the difficulties, measures of performance and adequacy do make possible 
the kind of theoretical statements already made in the discussion of the 
teaching system. Theoretical statements are also possible when we move to 
examining the efficiency of distance education. Cost-effectiveness analysis is 
one possible technique. If we accept that measures of performance such as 
examination pass rates are acceptable indicators, then it is legitimate to ask 
whether distance teaching or conventional teaching is a cheaper or dearer way 
of achieving the same result. There are often practical difficulties in that 
^nhorts of students in the two modes are not similar. And the quality of the 
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cost-effectiveness research has been criticised by Carnoy and Levin (1975) who 
argue that much of it displays a 'benefit of the doubt* bias in favour of 
distance education. Nevertheless, enough work has been done in analysing costs 
for us to seek theoretical statements here. 

Distance teaching would seem, on the face of things, attractive to financiers of 
education because it promises economies of scale, allowing educational resources 
to go further than is possible with conventional education and a measure of 
capital- labour sustititution. (cf. Jamison and Orivei 1982, p. 255). We would 
therefore expect theoretical statements about the economics of distance 
education to concern themselves with such substitution. As the cost of 
producing materials and administering a distance- teaching service are additional 
to the costs of running an ordinary school system we can claim that, where 
distance teaching Includes some face-to-face teaching, if in a distance-teaching 
system the costs of face-to-face support rise to the level of those in 
conventional education, then the costs of distance teaching cannot compare 
favourably with those of the conventional system . 

We can go at least one stage further in the analysis, Assuming that we define 
•favourable economic outcome* of distance education as a success rate at costs 
lower than those achJeved by conventional education, then we can argue that a 
favoura ble economic outcome for any one distance- teaching course is a function 
of three factors, the number of students, the amount of face-to-face study and 
the sophistication of the media used. Figure 2 shows this in diagrammatic form. 
It enables us to define a surface (a^,by,C;^) at which unit costs are the same 
for conventional and for distance education. 
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While we lack the data to put monetary values, in all but a few cases, on the 
building bricks which make up the block in figure 2, its existence and the 
theoretical argument behind it, may serve as a guide both to data collection and 
to planning. The figure illustrates, too, the need for the three systems of 
analysis and the relation between them: as a guide to administrative planning it 
needs advice from the teaching system about the sophistication of the teaching 
media needed for a particular audience and subject, and about the role of face- 
to-face learning, while it needs to be informed by the assessment system about 
trade-offs such as that between the numbers to be reached and the amount of 
face- to- face learning permitted. 
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Assessing process , with necessary questions about the quality of the educational 
experience as opposed to Its performance, adequacy or efficiency, Is more 
difficult and more controversial. I would, however, argue that we need to go on 
and ask how far the process of learning at a distance Is, in Itself, rewarding 
for the learner, or how far It is merely a dreary means to an end, justified 
because of the value of tne objectives bat not Justified through its intrinsic 
worth as a human activity. 

Indeed, I would go on to claim that evaluation of process has been comparatively 
neglected and that there are reasons to play it up which spring from the nature 
of distance education. For distance education faces the danger that it will 
encourage rote learning, will rely on extrinsic rather than intrinsic rewards, 
and will deprive its students of some of the mc valuable parts of the 
educational process. We know that distarce education is an effective way of 
conveying information but at the same tine that, with its necessary reliance on 
the written text, it can easily degeneratts Into rote learning. Kirk, for 
example, has suggested that the greatest intellectual benefits of the Open 
University go to the writers of courses rather than the students and warns of 
•the danger of a mass-produced student product which is of Inferior calibre to 
that of conventional universities* (Kirk 1975, p.4). A concern for process can 
help us keep asking questions about distance education's value for Induction and 
initiation as well as for the transfer of Information or the training in skills. 

An excessive reliance on extrinsic rewards is not inherent to distance 
education. But in practice the widespread use of an object Ives- led model of 
course development may lead towards this and towards the dangerous assumption 
that what is easily assessed is necessarily worth learning. In contrast, as 
Stenhouse has argued. 

The aim, 'to understand Hamlet', is not susceptible of analysis in terms of 
content elements. Here, 'understanding' means to respond to or experience 
the concrete reality of a work of art. The response or experience is 
individual, though there are canons by which we can Judge its 
appropriateness, by which one can discriminate understanding from 
misunderstanding. It might be tempting to couch objectives in terms of 
these canons, adopting as an aim 'to develop literary judgment'; but it 
seems to me that this aim cannot be analysed into pre-specif led student 
behaviours in any way. ... To use the play as a vehicle for teaching skills 
is to imply - and students rather readily pick up the implication - that 
the skills and vocabulary and so forth are the important matter rather than 
the play. 

(Stenhouse 1971, pp 75-6) 
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It Is because of the neglect of process that the most formidable challenges can 
be mounted against distance education as offering the shadow rather than the 
substance of education. But I have one further reason for stressing the 
evaluation of process: because It Is something under our control. If our 
concern Is with the external value of our work, or of the extrinsic benefits 
that our students will derive from It, then we may well get it all wrong, teach 
our students things that will In practice be of little benefit to them and, 
because of the difficulty of disentangling the effects of our work from those 
of other variables, never realise what we have done. In assessing process, on 
the other hand, we are not concerned with future benefits that our students may 
obtain, but with the value of the work they are doing while they are our 
students. 



The evaluation of process Is thus a necessary part of the assessment system. 
It is also the part where the literature gives the least help in suggesting how 
we should do it: another feature which is common to the evaluation of 
conventional education. The link between It and the assessment of adequacy 
suggests that it Is legitimate to talk of a system of assessment with necessary 
interrelationships between its constituent elements. By using a combination of 
the measures and Indicators discussed In this system we can seek to make some 
assessment of performance, adequacy, efficiency and process, although there 
remain methodological challenges for us here, especially in the evaluation of 
process. 

Especially In discussing process, I have strayed from discussing the techniques 
of essessment Into a discussion of the values I would choose and use In making 
an assessment. There Is no escaping this. Even if we decide to use a battery 
of evaluative measures, we will need to seek trade-offs between conflicting 
goals. High pass rates, for example, may conflict with low unit costs or large 
and socially diverse audiences. Or we may find that we cen improve our 
performance, as measured by examination results, by using styles of teaching 
that we also regard as being part of an inferior process; a familiar dilemma. 

Let me therefore conclude, in the way I began, by laying my remaining cards on 
the table. In carrying out assessment we have to start from a political or 
philosophical judgment that Informs our choice of priorities and of evaluative 
^ criteria. Examples from the recent history of distance education demonstrate 
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that agreement about the value Judgments used in assessment cannot be 
universal. It has been claimed, for example, that one of the advanta5es of the 
Free University of Iran, in the eyes of the Shah's regime which established it, 
was that distance education allowed students to get degrees without gathering 
together, when they might pose a threat. Yet few of the published apologists 
for distance education see its convenience for autocratic regimes as a benefit. 
Less dramatic views about distance education can also be controversial; some 
writers have ergued that a strength of distance education Is that It develops a 
degree of autonomy in its learners^^. But the development of the autonomous 
ability to learn would be an inappropriate measure for a distance- teaching 
activity like the Tanzanian radio campaign on health whose aim was to stimulate 
co-operative action by groups of villagers. 

Thus the two questions proposed below about the quality of the educational 
process of a distance- teaching programme represent an Individual view of the 
more Important criteria for use within the assessment system. They are not 
posed as an alternative to the battery of measures suggestea nor Is It claimed 
that they are the only Important ones. Rather they serve to Illustrate the 
point that, while the assessment system Is a necessary part of the proposed 
framework for analysing distance education, we cannot assume unlversel 
agreement about the criteria to be used within that system. 

My two key questions are these. First, does the programme lead to open-minded 
enquiry and not merely to rote learning and sometimes examination success. The 
diploma disease can be endemic but for me Is not what a liberating education Is 
all about. Reverting to Stenhouse's categories, we need to ask how far distance 
education can lead towards induction and Initiation and how far It Is limited to 
Instruction and training. 

The second question concerns social equity. We can ask whether a distance- 
education programme is Increasing or decreasing social equity. On the face of 
It, programmes of distance education which widen educational opportunity would 
seem to promote equity. But Bock and Papaglanis (1983) have argued that some 
nonformal programmes are In practice, it not by design, containing educational 
demand rather than Increasing equity. The question Is not easy: by offering an 
Inferior education <lf that Is what we are doing) to people outside school who 
gp^^l'v otherwise get none, we are doing something to widen educational 
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opportunity, even If we are not restructuring an educational system In a way 
which makes It more egalitarian as a whole and may be helping to legitimise a 
system stratified on class lines. Thus, my final question for a distance- 
teaching programme Is to ask whether It is Increasing, or has the potential to 
Increase, social equity. 

Conclusion 

The argument of this paper can now be summarised briefly While It Is naive to 
seek a single theory of distance education. It may be useful to examine distance 
education In terms of three Interrelated systems of teaching, administration and 
assessment. This examination provides a coherence that may be useful both for 
teaching and for the Improvement of practice. In the teaching system, it is 
possible to make theoretical statements, using the term 'theory' in a strict and 
narrow sense. While the statements made here are in too general a form to be 
of great practical value, they suggest a way In which narrower, and more useful, 
dependent theories can be developed from them. In the administrative system, 
generalisations can be drawn from practice which may offer useful heuristics 
and may, in time, serve as the basis for administrative theories. In the 
assessment system, we need both to make value judgments about educational 
quality and to seek Indicators of that quality. Given agreement on values, some 
theoretical statements can then be made about the economic assessment of 
distance education. But the values themselves, while being a necessary 
underpinning of the theories and generalisations examined, are external to them 
and derived from political philosophy rather than from the practice of 
education. 



Dr Perraton is an education officer at the Commonwealth Secret ariat but the 
views In this paper are his own and do not necessarily represe nt those of the 
Secretariat. 
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Figure 1: Three related systems for analysing distance education 
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Figure 2: A model for comparing the costs of conventional and distance 
education 
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Notes 

1 Using the word In this iimitea sense, much of the published discussion about 
the theory of distanr.e education is not theoretical at all; it does not lead to 
refutable propositions. I would, to take one example, now argue that only part of 
the discussion in Perraton (1981) is stricth' theoretical. I would also argue that 
the variety of phenomena with which we are dealing in the practice of distance 
education is such that it is misleading to seek a single, a ll-embracing, theory. 

2 Peters sees this as the essential feature of higher education where 'teacher 
and taught ... are both participating in the shared experience of a common wo^ld' 
(1972, p. 104). For a thinker like Freire, it is the essence of education at its 
most basic (cf Freire 1972). 

3 There are important exceptions to this including occasional face-to-face 
sessions, telephone conferences and the use of satellite communication, as In the 
University of the West Indies UWIDITE project. But it Is necessary to examine the 
power of distance education where such personal, Immediate, two-way communication 
is not available if our theories are to be useful under more usual circumstances, 

4 I have discussed administration in more detail in Perraton (1987) and In a 
course module for the University of Surrey Diploma in the Practice of Higher 
Education (Perraton with Lewis 1985). There is also an extensive literature on 
this from the British Open University and some useful guides to practice such as 
Dodds (1983). 

5 There is, of course, a danger here of pre-emptive categorisation, of making 
classifications in a way which pre-empts the theoretical ordering of material 
which may come as and when theory is dev^eloped. But the practical advantages of 
categorising and generalising in discussing administration seem to me to outweigh 
these dangers. 

6 Various classlf Icatory systems, which vary In detail, have been proposed by, 
among others, el Bushra (1973), and Keegan and Rumble (1982). 

7 In practice, distinctions may not be as clear-cut as the typology suggests. 
The Indira Gandhi National Open University, for example, belongs In class 1 but 
has a co-ordinating function which places U, with other Indian universities 
teaching at a distance, within a co-operat. e structure and so also In class 4. 
Even with the subdivisions proposed In class 3 there can be difficulties of 
classification: a department like the College of Adult and Distance Education of 
the University of Nairobi belongs In class 3.3 but has a small number of subject 
specialists of Its own, Purists might argue that we should really have six groups 
In class 3 and that the division between single-subject and multi-subject 
Institutions cuts across the other categories. 

8 McAnany used five categories, setting effort, the quality and quantity of work 
done In the programme, as the first. While measures of effort are, of course, a 
part of some evalautlve processes, I see them rather as a means to the end of 
assessing efficiency or performance than as a separate criterion. I have also 
borrowed the term 'process' from McAnany's scheme but use It not In the sense 
that he did of 'how and why a program works or falls to work' but In the sense 
used by Bruner and Stenhouse. 

9 In practice, of course, there are difficulties in using this Indicator as a 
comparative measure where the target population of a distance- teaching programme 
Is different from the population of other examination entrants. 
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10 Leslie (1978) discusses the issupc cf evaluation in relation to health 
campaigns generally. See also Manoff (1977) on Nicaragua and the Philippines and 
Hall (1978) on Tanzania. 

11 The philosophical objections to rate of return analysis apply with as much 
force here as they do wore generally. 

12 Wedemeyer and Moore have argued this case (cf Moore 1903); following the 
analysis used in this paper I would claim that their statements about autonomous 
learners are generalisations rather than theory but also that they move from 
descripwion into value judgment, 
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